Forward- Douglas- Rachford splitting and forward- partial 
inverse method for solving monotone inclusions * 



Luis M. Briceno- Arias 1 

1 Universidad Tecnica Federico Santa Maria 
Departamento de Matematica 
Santiago, Chile 



Abstract 

We provide two weakly convergent algorithms for finding a zero of the sum of a maximally monotone 
operator, a cocoercive operator, and the normal cone to a closed vector subspace of a real Hilbert 
space. The methods exploit the intrinsic structure of the problem by activating explicitly the 
cocoercive operator in the first step, and taking advantage of a vector space decomposition in 
the second step. The second step of the first method is a Douglas-Rachford iteration involving 
the maximally monotone operator and the normal cone. In the second method it is a proximal 
step involving the partial inverse of the maximally monotone operator with respect to the vector 
subspace. Connections between the proposed methods and other methods in the literature are 
provided. Applications to monotone inclusions with finitely many maximally monotone operators 
and optimization problems are examined. 

2000 Mathematics Subject Classification: Primary 47H05; Secondary 47J25, 65K05, 90C25. 

Keywords: composite operator, convex optimization, decomposition, partial inverse, minimization algorithm, 
monotone inclusion, monotone operator, operator splitting 



'Contact author: L. M. Bricefio-Arias, luis.briceno@usm.cl, phone: +56 2 432 6662. This work was supported by 
CONICYT under grant FONDECYT 3120054, by "Programa de financiamiento basal" from the Center for Mathematical 
Modeling, Universidad de Chile, by Anillo ACT 1106, and by Project Math-Amsud N 13MATH01. 



1 



1 Introduction 



This paper is concerned with the numerical resolution of the following problem. 

Problem 1.1 Let H be a real Hilbert space and let V be a closed vector subspace of H. The normal 
cone to V is denoted by Ny. Let A : Ti — > 2^ be a maximally monotone operator and let B: ~H — > % 
be a /3-cocoercive operator in V, i.e., it satisfies 

(Vxe~l/)(Vyey) (x - y | Bx - By) > f3\\Bx - By\\ 2 . (1.1) 

The problem is to 

find x eli such that E Ax + Bx + AVx, (1.2) 
under the assumption that the set of solutions Z of (1.2) is nonempty. 

Problem 1.1 arises in a wide range of areas such as optimization [18, 44], variational inequalities 
[31, 46, 47], monotone operator theory [23, 37, 32, 43], partial differential equations [26, 27, 31, 34, 51], 
economics [29, 36], signal and image processing [2, 3, 13, 14, 21, 22, 39, 40, 48], evolution inclusions 
[1, 28, 42], and traffic theory [8, 9, 25, 38, 41], among others. 

In the particular case when B = 0, (1.2) becomes 

find x G V such that (3 y G V^) y G Ax, (1.3) 

where stands for the orthogonal complement of V. Problem (1.3) has been studied in [43] and it 
is solved with the method of partial inverses. On the other hand, when V = ~H, (1-2) reduces to 

find x G H such that G Ax + Bx, (1.4) 

which can be solved by the forward-backward splitting (see [16] and the references therein). In 
the general case, Problem 1.1 can be solved by several algorithms, but any of them exploits the 
intrinsic structure of the problem. The forward-backward splitting [16] can solve Problem 1.1 by 
an explicit computation of B and an implicit computation involving the resolvent of A + Ny. The 
disadvantage of this method is that this resolvent is not always easy to compute. It is preferable, hence, 
to activate separately A and Ny . In [35] an ergodic method involving the resolvents of each maximally 
monotone operator separately is proposed, and weak convergence to a solution to Problem 1.1 is 
obtained. However, the method includes vanishing parameters which leads to numerical instabilities 
and, moreover, it involves the computation of (Id+7-B) -1 for some positive constant 7, which is not 
always easy to compute explicitly. The methods proposed in [11, 17, 19, 43] for finding a zero of the 
sum of finitely many maximally monotone operators overcomes the problem caused by the vanishing 
parameters in [35], but it still needs to compute (Id +7-B) -1 . The primal-dual method proposed in 
[49] overcomes the disadvantages of previous algorithms by computing explicit steps of B. However, 
the method does not take advantage of the vector subspace involved and, as a consequence, it needs to 
store several auxiliary variables at each iteration, which can be difficult for high dimensional problems. 

In this paper we propose two methods for solving Problem 1.1 that exploit all the intrinsic properties 
of the problem. The first algorithm computes an explicit step on B followed by a Douglas-Rachford 
step [32, 45] involving A and Ny. The second method computes an explicit step on B followed by 
an implicit step involving the partial inverse of A with respect to V. The latter method generalizes 
the partial inverse method [43] and the forward-backward splitting [16] in the particular cases (1.3) 
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and (1.4), respectively. We also provide connections between the proposed methods, we study some 
relations with other methods in the literature, and we illustrate the flexibility of this framework via 
some applications. 

The paper is organized as follows. In Section 2 we provide the notation and some preliminaries. In 
Section 3 we provide a new version of the Krasnosel'skh-Mann iteration for the composition of averaged 
operators. In Section 4 the latter method is applied to particular averaged operators for obtaining the 
forward-Douglas-Rachford splitting and in Section 5 the forward-partial inverse algorithm is proposed. 
We also provide connections with other algorithms in the literature. Finally, in Section 6 we examine 
an application for finding a zero of a sum of m maximally monotone operators and a cocoercive 
operator and an application to optimization problems. 



2 Notation and preliminaries 

Throughout this paper, H is a real Hilbert space with scalar product denoted by (• | •) and associated 
norm || • ||. The symbols — v and — > denote, respectively, weak and strong convergence and Id denotes 
the identity operator. The indicator function of a subset C of H is 

f 0, if x G C; . , 

ic:x^{ ' ' (2.1) 

[+oo, if x f. C, 

if C is nonempty, closed, and convex, the projection of x onto C, denoted by Pqx, is the unique point 
in Arguiin^^ \\x — y\\, and the normal cone to C is the maximally monotone operator 



I 0, otherwise. 



(2.2) 



An operator R: % — > H is nonexpansive if 

(Vx G "H)(Vy G H) \\Rx - Ry\\ < \\x - y\\ (2.3) 

and Fixi? = {x G % \ Rx = x} is the set of fixed points of R. An operator T: % — > % is a-averaged 
for some a G]0, 1[ if 

T=(l-a)Id+aR (2.4) 
for some nonexpansive operator R, or, equivalently, 

NxeU)NyeU) \\Tx-Ty\\ 2 < \\x - y\\ 2 - — -||(Id-?>- (Id-T)yll 2 , (2.5) 

a 

or 

(Vx G %)(Vy G %) 2(1 - a) (x - y | Tx - Ty) > \\Tx -Tyf + (1 - 2a)\\x - y\\ 2 . (2.6) 
On the other hand, T is /3-cocoercive for some /? G ]0, +oo[ if 

(VxG^)(VyG^) (x — y \ Tx - Ty) > f3\\Tx - Ty\\ 2 . (2.7) 

We say that T is firmly nonexpansive if T is 1/2-averaged, or equivalently, if T is 1-cocoercive. 
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We denote by gr&A = {(x, u) G % x T-L \ u G Ax} the graph of a set- valued operator A: % — > 2 H , 
by dom^ = | Ax 7^ 0} its domain, by zer A = | G Ax} its set of zeros, and 

by J a = (Id+vl) -1 its resolvent. If A is monotone, then J a is single-valued and nonexpansive and, 
furthermore, if A is maximally monotone, then dom J a = T~L- Let A: % — > 2^ be maximally monotone. 
The reflection operator of A is Ra = 2Ja ~ Id, which is nonexpansive. The partial inverse of A with 
respect to a vector subspace V of H, denoted by Ay, is defined by 

(V(x,y)£H 2 ) yeA v x ^ (PvV + Pv xX ) ^ A(Pyx + Py±y). (2.8) 

For complements and further background on monotone operator theory, see [1, 7, 43, 50, 51]. 



3 Krasnosel'skii— Mann iterations for the composition of averaged 
operators 

The following result will be useful for obtaining the convergence of the first method. It provides 
the weak convergence of the iterates generated by the Krasnosel'skii-Mann iteration [16, 30, 33] 
applied to the composition of finitely many averaged operators to a common fixed point. In [7, 
Corollary 5.15] a similar method is proposed with guaranteed convergence, but without including 
errors in the computation of the operators involved. On the other hand, in [16] another algorithm 
involving inexactitudes in the computation of the averaged operators is studied in the case when such 
operators may vary at each iteration. However, the relaxation parameters in this case are forced to 
be in ]0, 1]. We propose a new method which includes summable errors in the computation of the 
averaged operators and allows for a larger choice for the relaxation parameters. First, for every strictly 
positive integer i and a family of averaged operators {Tj)i<j< m , let us define 

m [ Tj o T,_i_i o • • • o T m , if i < m; , 
UTj = < + ' ~ ' (3.1) 

j= l I Id, otherwise. 

Proposition 3.1 Let m > 1, for every i G {1, . . . , m}, let on G ]0, 1[, let Ti be an cti-averaged operator, 
and let (ej jn ) ng N be a sequence inH. In addition, set 

m max{a lr .. ,a m } 

a = -. — F 7, (3.2) 

1 + (m — 1) maxjai, . . . , a m \ 

let (A n ) ng N be a sequence in ]0, l/a[, suppose that Fix(T! o • • • o T m ) ^ 0, and suppose that 

^ A n (l - aA n ) = +00 and (Vi G {1, . . . , m}) ^ A n ||e iin || < +00. (3.3) 

neN neN 

Moreover, let zq G % and set 

(Vn G N) z n+1 = z n + A n (Ti (T 2 (• • • T m _i (T m z n + 

&m,n) ~r Cm— l,n ) + e 2 , n ) + ei 

■ (3-4) 

Then the following hold for some z G Fix(Ti o • • • o T m ). 
(i) z n -± z. 
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(ii) ^2 A n (l - aX n ) 

neN 



n Tjz n z n 



< +00. 



(iii) II TjZ n - z n -> 0. 

(iv) z n+ i - z n -4 0. 

En m 
A n (Id — Tj) n - (Id -Ti) n Tj 
, , ... II 



neN 



j=i+l 



< +OO. 



Proof, (i): First note that (3.4) can be written equivalently as 

(Vn G N) z n+ i = z n + X n (Tz n + e n - z n ), (3.5) 

where 

/ m 

T = Ti o To o • • • o T m = II T,2;„ 

i=i J (3.6) 

e„ = Ti(T 2 (- • • T m _i(T m z n + e m , n ) + e m _i jn • • • ) + e 2 , n ) + ei, n - Tz n . 

It follows from [16, Lemma 2.2(iii)] that T is a-averaged with a defined in (3.2), and, using the 
nonexpansivity of (Tj)i<j< m , we obtain, for every n G N, 

) + e 2 ,„) -T 1 (T 2 (-- (T m Z n ) • • • )) II + ll e l,n|l 

< ||T 2 (T3(- • -T m _i(T m z n + + ) + e 3 ,„) -T 2 (r 3 (-- 

+ ||e 2 , n || + ||ei, n || 

< 



m 

— ^ ^ ||^i,n II • 
i=l 



T m -i !! + ••• + ||e 2 ,n|| + ||ei,n| 



Hence, it follows from (3.3) that 

^ 1 A n ||e n || = ^ ^ X n ^ ^ ||cj,n|| = ^ ^ ^ ^ A n ||ej in || < + 



00. 



(3.7) 



(3.8) 



neN 



neN i=l 



i=l neN 



Now, set R = (1 — 1/a) Id +(l/a)T and, for every neN, set = aX n . Then it follows from (2.4) 
that i? is a nonexpansive operator, Fixi? = FixT, and (3.5) is equivalent to 

(Vn G N) z n+ i = z n + fi n (Rz n + c n - z n ), (3.9) 

where c n = e n /a. Since (/J, n )neN is a sequence in ]0, 1[ and (3.3) and (3.8) yields XlneN PnO-— f^n) = + 00 
and X^nGN ll^fi II < the result follows from [16, Lemma 5.1]. 

(ii): Fix n G N. It follows from (3.5), Cauchy- Schwartz inequality, and [7, Lemma 2.13(h)] that 



\Zn+l 



■ z\\ 2 = ||(1 - X n )(z n - z) + X n (Tz n -Tz + e n )\\ 2 



< ||(1 - X n )(z n -z) + X n (Tz n - Tz)\\ 2 + e n 

= (1 - X n )\\z n -z\\ 2 + A n ||Tz n - Tz\\ 2 - A n (l - X n )\\Tz n - z n \\ 2 + e r> 



(3.10) 
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where, 

(Vfc GN) e k = X 2 k \\e k \\ 2 + 2A fc ||(l - A fc )(z fc - z) + X k (Tz k - Tz)||||e fc ||. 
Note that the convexity of || • ||, the nonexpansivity of T, and (i) yield 

= X) A fcii e fcii 2+2 IZ A feii( 1 - A fc)^-^ + Afe ( rzfe - :ri )iiii efe ii 

fcgN fceN fceN 

< (^A fe ||e fc ||) 2 + 2^A fc ((l-A fc )lkfc-^|| +A fc ||rz fc -rz||)||e fc | 

feeN ' fcgN 

< (^ Afe H efc ll) + 2 ( su Pll z fc ^A fc ||e fe || < +00. 

fceN feeN ken 



(3.11) 



(3.12) 



On one hand, since T is a-averaged, it follows from (3.10) and (2.5) that 
■=112 / ,t \ mi- -=112 , x A_ ^112 C 1 - «) 



kn+l-^ll < (1 - K)\\Zn ~ z|| + A n ||z n - 2 



ft 



A n (l — A n )||Tz n — z n \\ 2 + e r 



— II Z n z\\ \\Tz n Zfi I + £)i, 

ft 



(3.13) 



and, hence, the result is deduced from [15, Lemma 3.1(iii)]. 

(iii): It follows from (3.3) and (ii) that lim \ \Tz n — z n \\ = 0. Moreover, it follows from (3.5) that 



(Vn G N) \\Tz n+ i - z n+ i\\ < \\Tz n+1 - Tz n \\ + (1 - \ n )\\Tz n - z n \\ + A n ||e n | 

< l! z n+l ~~ z n|| + (1 — A n )||Tz n — z n \\ + A n ||e n || 
<\\Tz n z n I) + 2A n ||e n || . 



(3.14) 



Hence, from (3.8) and [15, Lemma 3.1] we deduce that (||Tz„ — z n ||)neN converges, and therefore, 

Tz n - Z n ^0. 

(iv): Prom (3.5), (3.6), (iii), and (3.8) we obtain 

\\z n +i - z n \\ < A n ||Tz n - z n \\ + A n ||e n || < (l/a)\\Tz n - z n \\ + A n ||e n || ->■ 0. (3.15) 



(v): Since (Tj)i<i< TO are averaged operators, we have from (3.6) and (2.5) that 
\\Tz n -Tz\\ 2 < 
< 



m m 

IT TjZ n — LT TjZ 
j=2 j=2 

m m 

n Tjz n — n T{z 

j=3 j=3 



2 1 


— ftl 




ftl 


2 1 


— ft2 




ft 2 


1 


— ftl 


ftl 



(Id -Ti) n^j-js,, - (Id -Ti) ILTjZ 



(id -t 2 ) n r^ n - (id -t 2 ) n r,-z 

3=3 3=3 
m m 

(id -Ti) n r 7 z n - (id -Ti) n r 7 z 
3=2 J 3=2 J 



E 

i=l 



1 - «i 



ft, 



(Id-TO n ^-(Id-T,) n T/2 

J=i+1 3=«+l 



(3.16) 
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Hence, from (3.10) we deduce 



— 1|2 s II — 1| 2 

l^ra+l ~~ z \\ — \\ z n — Z\\ 



1 - OLi 



1=1 



an 



(Id -Ti) n 7> n - (Id -Ti) . n 2)2 + e n . (3.17) 



j=i+l 



j=i+l 



Therefore, it follows from [15, Lemma 3.1(iii)] that 



E 

7=1 



1 - OLi 



En 77i m 

A n (id -to n r^-cid-TO n t, 

II J=«+l .7=7 + 1 

1 — Q 



7i eN 



E^»E 

neN 7=1 



(Id-Tj) II T j z n - (Id-!;), n Tjz < +oo, (3.18) 



j=i+i 



j=i+i 



which yields the result. □ 



Remark 3.2 In the particular case when m = 1, Proposition 3.1 provides the weak convergence 
of the iterates generated by the classical KrasnosePskh-Mann iteration [16, 30, 33] in the case of 
averaged operators. This result is interesting in this own right since it generalizes [7, Proposition 5.15] 
by considering errors on the computation of the involved operator and provides a larger choice of 
relaxation parameters than in the nonexpansive case (see, e.g. ,[16, 30, 33]). 

4 Forward-Douglas-Rachford splitting 

In this section we provide the first method for solving Problem 1.1. We provide a characterization of 
the solutions to Problem 1.1, then the algorithm is proposed and its weak convergence to a solution 
to Problem 1.1 is proved. 



4.1 Characterization 

Let us start with a characterization of the solutions to Problem 1.1. 

Proposition 4.1 Let 7 £ ]0, 2/3[ and TI, V , A, B, and Z be as in Problem 1.1. Define 



'T 7 = |(Id +R jA o R Nv ): U^U 
S = Id - 7 Py oBoPy.U^U. 



Then the following hold. 



(4.1) 



(i) T 7 is firmly nonexpansive. 

(ii) 5 7 is 7 / '(2/3) -averaged. 

(iii) Let x Then x G Z if and only if 

xeV and (3 y G V ± n (Ax + Bx)) such that x — j(y — P v a_Bx) G Fix(T 7 o 5 7 ). 



(4.2) 
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Proof, (i): Since jA is maximally monotone J^a is firmly nonexpansive and R^a = 2JjA — Id 
is nonexpansive. An analogous argument yields the nonexpansivity of Rn v = 2Py — Id. Hence, 
R 1 A Rn v is nonexpansive and the result follows from (2.4). 

(ii): Since V is a closed vector subspace of H we have that Py is linear and Py = Py. Hence, the 
cocoercivity of B in V yields, for every (z, w) £ H 2 and 7 £ ]0, 2/3 [, 

(* -10 I "fPv{B(P V z)) - 1 Py{B{Pyw))) =j(P V Z - PyW I £(Py2) - B(Pyw)} 

> 1 P\\B{Pvz)-B{Pyw)\\ 2 

(l3/ 7 )\\ 7 Py(B(Pyz)) - 7 Pv(B(Pyw))\\ 2 . (4.3) 



> 



Since 7 £ ]0, 2/3 [ the result follows from [16, Lemma 2.3]. 

(iii): Let x £ % be a solution to Problem 1.1. We have x € V and there exists y £ V -1 = iVyx such 
that y £ Ac + Bx. Set 2 = x — j(y — P v ±Bx). Note that Rn v z = 2Pyz — z = x + 7(2/ — P v ±Bx) 
and Pyz = x. Hence, since -B is single valued and, for every w £ V, Ryw = w, it follows from the 
linearity of that 

x + ly _ 1 B X = x + 1 (jj_ P y± Bx) - -/PyBx = R Nv Z - -/PyBPyZ = R Nv {z - -fPyBPyz), (4.4) 

and, therefore, 

y £ Ax + Bx <^ x + 72/ — 7PX £ x + 7^4x 

^ x = J^a{x + 72/ - jBx) 

^ x = J lA {Rn v (z - jPyBPyz)) 

& x=~ (2J jA {Rn v (z - jPyBPyz)) - R Nv {z - jPyBPyz) + x + 72/ - 7j Bx) 

X = ]i{ R -y A ( RN v( z ~ iPvBPyz)) + x + 72/ - 7W) 

& X = -(B^AiRNyiz - jPyBPyz)) +Z- jPyBPyZ^j + 7(2/ - Py±Bx) 

& z = T^o SjZ, (4.5) 

which yields the result. □ 



4.2 Algorithm and convergence 

In the following result we propose the algorithm and we prove its convergence to a solution to Prob- 
lem 1.1. The method is inspired from the characterization provided in Proposition 4.1 and Proposi- 
tion 3.1. 

Theorem 4.2 Let H, V, A, B, and Z be as in Problem 1.1, let 7 £ ]0,2/3[, let a = max{2/3, 27/(7 + 
2/3)}, let (A n ) ne N be a sequence in ]0, l/a[, let (a n ) ng N and (6 n )neN be sequences in %, and suppose 
that 

} y A n (l - a\ n ) = +00 and ^ A n (||a n || + ||6 n ||) < +00. (4.6) 

raGN raeN 
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Moreover, let zq G % and set 





%n — 


Pyz n 




Vn = 


(x„ ~ 2n)/7 


G N) 


Sn — 


a^n - 7-fV {Bx n + a n ) + 7?/ n 




Pn = 


J"/ASn ~\~ 




Zn+1 





(4.7) 



T/ien t/ie sequences (x n ) ng pj and (y n )neN are in V and V 1 - , respectively, and the following hold for 
some x G Z and some y G V -1 - n (Ax + PyBx^j . 

(i) x n x and y n y. 

(ii) x n+1 - x„ and y n+1 - y n 0. 

(iii) Y.neN X n\\Pv(Bx n - Bx)f < +oc. 



Proof. First note that (4.7) can be written equivalently as 



(Vn G N) 



X n — PyZ n 
y n = -P V -LZ n /l 

— Zn ~i~ A n (T'y(S^Z n -\- C n ) + b n Z n ) , 



(4.8) 



where T 7 and 5 7 are defined in (4.1) and, for every n G N, c n = — ^Pya n . We have from (4.6) that 
X] A n(IIM + l|c„||) < /^KUKW +7IKII) < max{l,7}^A n (||a n || + ||b n ||) < +00. (4.9) 

Moreover, it follows from Proposition 4.1(i)&(ii) that T 7 is 1/2-averaged and 5 7 is 7/(2/3)-averaged. 
Altogether, by setting m = 2, T\ = T 7 , T 2 = 5 7 , ai = 1/2, a 2 = 7/(2/3), ei >n = 6 n , e 2 , n = c„, and 
noting that 

2 m „ { l/2^/(2ff)} = + 
1 + max{l/2, 7/(2/3)} 
it follows from Proposition 3.1 that there exists z G Fix(T 7 o 5 7 ) such that 

z n ^z (4.11) 

(4.12) 

^ X n \\(ld-S y )z n - (ld-S 7 )z\\ 2 < +00. (4.13) 

nGN 

Now set x = Py~z and y = —Py±_z/j. It follows from Proposition 4.1 (iii) that x is solution to 
Problem 1.1 and y = y — P v ±Bx for some y G V PI (Ax + Then, y G V PI (Ax + PyBx). 

(i) : It is clear from (4.8) and (4.11) that x n — 1 x and y n — 1 y. 

(ii) : It is a consequence of (4.12) and 

(Vn G N) \\z n+1 - z n \\ 2 = \\x n+ i - x n \\ 2 +j 2 \\y n+1 - y n \\ 2 . (4.14) 

(iii) : It follows from (4.1) that 

(Vn G N) ||(Id-S 7 )z„ - (Id-5 7 )z|| 2 = ~f\\P v (Bx n ) -Py{Bx)\\ 2 . (4.15) 
Hence, the result follows from (4.13). □ 

Remark 4.3 Note that, if lim A n > 0, then Theorem 4. 2 (iii) implies Py{Bx n ) — > Py(Bx). 
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5 Forward-partial- inverse splitting 



We provide a second characterization of solutions to Problem 1.1 via the partial inverse operator 
introduced in [43]. This characterization motivates a second algorithm, whose convergence to a solution 
to Problem 1.1 is proved. The proposed method generalizes the partial inverse method proposed in 
[43] and the forward-backward splitting [16]. 

5.1 Characterization 

Proposition 5.1 Let 7 G ]0, +oo[ and TL, A, B, and V be as in Problem 1.1. Define 

U 1 = ( 1 A) v :U^2 n 

]B 1 = jP v o B o Py : % V. 

Then the following hold. 

(i) Ay is maximally monotone. 

(ii) B^y is f3 /^-cocoercive. 

(iii) Let x GTL. Then x is a solution to Problem 1.1 if and only if 

xeV and (3 y G V ± n (Ax + Bx)) such that x + j(y — P v ±Bx) £ zer(yl 7 + Z3 7 ). (5.2) 

Proof, (i): Since jA is maximally monotone, the result follows from [43, Proposition 2.1]. (ii): It 
follows from (4.1) that *8 7 = Id— and from Proposition 4.1(h) and (2.4) we deduce that there 
exists a nonexpansive operator i? 7 : TL — > TL such that i3 7 = Id— (1 — r y/(2/3)) Id —j/(2/3)Ry = 
(7//?) (Id — i? 7 )/2. Hence, since (Id— i? 7 )/2 is firmly nonexpansive, the result follows from (2.7). (iii): 
Let x G TL be a solution to Problem 1.1. We have x G V and there exists y G 1^ = Nyx such that 
y G Ax + -Bx. Since B is single valued and Py is linear, it follows from (2.8) that 

y G Ax + Bx 44> 77/ — 7BX G jAx 

& --fP v (Bx)e(jA) v (x + j(y-P v ±Bx)) 

O G ( 7 A) v (z + 7(y - -Py±Bx)) + 1 P v (B(P v (x + 7(1/ - P y xBx)))) 

O x + 7(7/ — P v ±Bx) G zer(Ay + B 7 ), (5.3) 

which yields the result. □ 

Remark 5.2 Note that the characterizations provided in Proposition 4.1 y Proposition 5.1 are related. 
Indeed, Proposition 4.1 (iii) and Proposition 5.1 (iii) yield 

Z = Py(Fix(T 7 o 5 7 )) = P v (zei(A 1 + B 7 )) and i2jv v (Fix(r 7 o 5 7 )) = zer(Ay + B 7 ). (5.4) 
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5.2 Algorithm and convergence 



Theorem 5.3 Let %, V , A, B, and Z be as in Problem 1.1, let 7 G ]0, +oo[, let e G ]0, max{l, /3/7}[, 
let (5 n ) ne N be a sequence in [e, (2/3/7) ~ £ ]> an d tet (^n)neN ^ e a sequence in [e, 1]. Moreover, let 
xq G V, Zei yo £ ^ /_L ? and, /or e?;ery n € N, consider the following routine. 

Step 1. Find (p„, g n ) G % 2 such that cc n - 5 n ^PyBx n + jy n = p n + 7g n 

and + Py±(?n e AfjV^. + • (5-5) 



d n V <),. 

Step 2. Set x n+ \ =x n + X n (P v p n - x n ) and y n+i = y n + X n (P v ±q n - y n ). Go to Step 1. 

Inen, i/ie sequences (x n ) n& ^ and (y n )neN in V and V- 1 , respectively, and the following hold for 
some x G Z and y G l^ -1 Pi (Ax + PyBx). 

(i) x n x and y n y. 

(ii) x n+ i - i n ->• and y n+ i - y n -> 0. 
(hi) PyBx n -4 PyBx. 

Proof. Since xo G F and yo S ^ /_L ) (5-5) yields (x n ) nS N C F and (y„) ne N C F -1 . Thus, for every 
n G N, it follows from (5.5) and the linearity of Py and P v ± that 



PyPn + jPvQn = Pv(Pn + 7<?n) = Pv(x n - 5 n ~fP v Bx n + 7y n ) = x n - 8 n jPvBx n 
Py^Pn + lPy±q n = Py± (Pn + 7<?n) = Py± {x n ~ d~ n jP v Bx n + 7y n ) = 7y n , 



(5.6) 



which yield 



Pyq-a = (x n - 5 n ^Bx n - PyPn)ll = ( x n ~ x n+ x)/ ('jXn) - 5 n P v Bx r , 
Py^Pn = i(y n - Py^Qn) = i{y n - y n +i) / X n . 



(5.7) 



On the other hand, from (5.5) we obtain 



n Xn+l X n yn+1 yn /r o\ 

Pyp n = x n -\ and P v ±q n = y n -\ . (5.8) 

An A n 

Hence, it follows from (5.7) and (5.5) that 

PyBx n + y n + Vn+ \ - yn eA(x n + Xn+ \ - Xn + I^LZfetO) , (5.9) 



A n ^n7 X n V X n X n 5 n 

or equivalently, 

(x n -X n+ i) l{yn+l ~ yn) _ ,/ . X n+ i - X ra 7(l/n ~ jfa+l) > |M , 

■jPyBx n + 7y„ H G7^ x n H 1 — . (5.10) 



X n S n X n \ X n X n 5 : 

Thus, by using the definition of partial inverse (2.8) we obtain 

(x n -x n+ i) j(y n -y n+ i) f x n+1 - x n + j(y n+1 - y n )\ 

jPyBx n ^ — G {jAjy I x n + jy n H r— ^ , (5.11) 



A n O n A n n \ A n 
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which can be written equivalently as 

x n +i ~ x n + 7(y n +i - Vn) 



X n + IVn ~ SnjPvBXn - [ x n + 7y n + 



= x i a\ ( i , x n+i -x n + -/(y n+1 -y n ) \ (r 
G 0„(7^4)y I x n + ji/n H - ). (5.12) 



Hence, we have 



. ^n+i x n + 7(y n +i y n ) , . 

a^n +72M H : = Js„(-yA) v {x n + IVn ~ b n ~{P v Bx n ), (5.13) 

An 

or equivalently, 

x n+ i + jy n +i = x n + 72/n + A n («/(5 n ( 7 A) v fan + IVn - 5 n jP v Bx n ) - x n + jy n ^j . (5.14) 

If, for every n 6 N, we denote r n = x n + 7y n , from (5.14) and (5.1) we have 

r n +i =r n + X n (J 5nAi (r n ~ b n Byr n ) - r n ) . (5.15) 

Since (<5 n )neN C [e, 2(^/7) — e], it follows from Proposition 5.1(i)&(ii) and [4, Theorem 2.8] that there 
exists r G zev(A y + By) such that r n ->> r, Byr n ->■ # 7 r, r n - r n+i = A n (r n - (r„ - <5 n # 7 r n )) -» 0. 
Hence, by taking x = Pyr and y = P v ±r/j, Proposition 5.1(iii) asserts that x G Z, y G V (7 (Ax-H 
PyBx), and the results follow from 

(V(x, y) G ^ 2 ) (x I y) = (P v x \ P v y) + {P v ±x \ P v ±y) (5.16) 

and the definition of By. □ 

Remark 5.4 

(i) It is known that the forward-backward splitting admits errors in the computations of the opera- 
tors involved [16]. In our algorithm these inexactitudes have not been considered for simplicity. 

(ii) In the particular case when 7 < 2/3, X n = 1, and B = 0, the forward-partial-inverse method 
reduces to the partial inverse method proposed in [43] for solving (1.3). 

The sequence (<5 n )neN i n Theorem 5.3 can be manipulated in order to accelerate the algorithm. 
However, as in [43], Step 1 in Theorem 5.3 is not always easy to compute. The following result show 
us a particular case of our method in which Step 1 can be obtained explicitly when the resolvent of A 
is computable. 

Corollary 5.5 Let 7 G ]0, 2j3[, let xo G V, let y$ G V 1 , let (X n )neN be a sequence in [e,l], and 
consider the following routine. 



(Vn G N) 



s n = x n - jP v Bx n + jy n 

Pn = J-yASn /g 
Vn+1 = Vn + (An/7) (PvPn ~ Pn) 
X n +1 = X n + X n (P V p n - X n ). 



Then, the sequences (x n ) ng N and (y n )neN are in V and V , respectively, and the following hold for 
some x G Z and y G V 1 - n {Ax + PyBx). 
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(i) x n -± x and y n -± y. 

(ii) x n+1 - x„ and y n+1 - y n 0. 

(iii) PyBx n ->■ PyBx 

Proof. For every n G N, set <jf n = (s n — p n )/l- It follows from (5.17) that 

J7<7n = S n -p n e jAp n 
\s n =Pn + 7<?n, 



(5.18) 



which yield x n - 5 n jP v Bx n + ^)y n =p n + 7<7n, Pn ~ PvPn = Py^Pn = l{Vn ~ Py^Qn), and q n G Ap n . 
Therefore, (5.17) is a particular case of (5.5) when 6 n = 1 G ]0, 2(^/7) [ and the results follow from 
Theorem 5.3. □ 

Remark 5.6 Note that, when V = H, (5.17) reduces to 

x n +i = x n + A n (J 7 A(x„ - 7-Bx n ) - x n ), (5.19) 

which is the forward-backward splitting with constant step size (see [16] and the references therein). 

Remark 5.7 Set a n = b n = in Theorem 4.2, set 7 G ]0, 2/3[ and 5 n = 1 in Theorem 5.3, and let 

(A n ) n£ N be a sequence in [e, 1] for some e G ]0, 1[. Moreover denote by (x n ,y n ) ne ^ the sequence in 

V x V 1 - generated by Theorem 4.2 and by (x n , y^)neN the sequence in V x V 1 - generated by Theorem 5.3 

when Xq = Xq = xq G V and y\ = y$ = yo G V^ -1 . Then, for every n G N, x\ = x n and = y n . 

Indeed, xj = Xq and t/q = Z/o by assumption. Proceeding by mathematical induction, suppose that 
1 2 _ „ „„j „.i _ „,2 



x n and y n = y^ = y n - Hence, we deduce from (4.7), a n = b n = 0, and (5.17) that 



x* +1 = x* + A n (iW 7 ^( x n - 7 p vBxi + 72/^; 

= x;; + A n (iW 7 ^( x n - lPvBx 2 n + iy 2 n )-x n ) 

= 4+1- (5-20) 
Moreover, since P^± = Id —Py, we obtain 

?/n+l = Vn ~ (^n/7)Py±J 1 A(x 1 n - jPvBx n + yy*) 
= Vn- (^n/l)Pv±J~/A(x n - jPyBxl + 7^) 

= 1^+1, (5-21) 

which yields the result. Therefore, both algorithms are the same in this case. However, even if both 
methods are very similar, they can be used differently depending on the nature of each problem. 
Indeed, the algorithm proposed in Theorem 4.2 allows for explicit errors in the computation of the 
operators involved in the general case and the relaxation parameters (A n ) ng N are allowed to be greater 
than those of the method in Theorem 5.3. On the other hand, the method in Theorem 5.3 allows 
for a dynamic step size S n in the general case, which is not permitted in the algorithm proposed in 
Theorem 4.2. 
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6 Applications 



In this section we study two applications of our algorithms. First we study the problem of finding a 
zero of the sum of m maximally monotone operators and a cocoercive operator and, next, we study 
the variational case. Connections with other methods in this framework are also provided. 



6.1 Inclusion involving the sum of m monotone operators 



Let us consider the following problem. 

Problem 6.1 Let (H, | ■ |) be a real Hilbert space, for every i G {1, . . . , m}, let Aj: H — > 2 H be a 
maximally monotone operator, and let B : H — > H be a /3-cocoercive operator. The problem is to 

m 

find xGH such that OG^AiX+Bx, (6.1) 

i=i 

under the assumption that such a solution exists. 



Problem 6.1 has several applications in image processing, principally in the variational setting (see, 
e.g., [18, 24] and the references therein), variational inequalities [46, 47], partial differential equations 
[34], and economics [29, 36], among others. In [24, 49] two different methods for solving Problem 6.1 
are proposed. In [49] auxiliary variables are included for solving a more general problem including 
linear transformations and additional strongly monotone operators. This generality does not exploits 
the intrinsic properties of Problem 6.1 and it restricts the choice of the parameters involved. On 
the other hand, the method in [24] takes into advantage the structure of the problem, but involves 
restricting relaxation parameters and errors. We provide an alternative version to the latter method, 
which allows for a wider class of errors and relaxation parameters. The method is obtained as a 
consequence of Theorem 4.2 and the version obtained from Theorem 5.3 is also examined. 

Let us provide a connection between Problem 6.1 and Problem 1.1 via product space techniques. Let 
(u)i)i<i<m be real numbers in ]0, 1[ such that Y^iLi w « = li ^ ^ be the real Hilbert space obtained by 
endowing the Cartesian product H m with the scalar product and associated norm respectively defined 
by 



where x 



(•]■): (x,y) ^ ^^fa | yi) and 

i=l 

( x i)i<i<m is a generic element of H. Define 



X h-> 



•2) 



V = {x = (xi)i<i< m G H | xi = • • • = x m } 
j: H->Vc?/:xh>(x,...,x) 
A: H -)■ 2 n : x ^ ^Aixi x ••• x -^A mXrr . 
B:H->H: x^ (Bxi,...,Bx m ). 



(6.3) 



Proposition 6.2 Let H, (Aj)i<j< m; and B be as in Problem 6.1, and let V , j, A, and B be as in 
(6.3). Then the following hold. 
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(i) V is a closed vector subspace ofH, Py. (x-i)i<i< m t-t j(Yli=i w i x i)> an d 

N v :H^2 n : l V± = { x = Wl<^ E U | Ei=i ^ = 0}, if x £ V; 

1 0, otherwise. 

(ii) j : H — > V is a bijective isometry and j _1 : (x, . . . , x) i— > x. 

(iii) A is a maximally monotone operator and, for every 7 G ]0,+oo[, J 7 a- ( x i)i<«<m ^ (^7A;/w, x i)- 

(iv) -B is f3-cocoercive, B(j(x)) = j(Bx), and .B(V) C V. 

(v) For every x G H, x is a solution to Problem 6.1 if and only if j(x) G zei(A + B + iVy). 

Proof. (i)&(ii): They follow from (2.2) and easy computations, (iii): See [7, Proposition 23.16]. (iv): 
Let x = (x,)i<j< m and y = (yi)i<i< m be in %. Then, it follows from (6.3) and the /3-cocoercivity of 
B that 

m m 

(Bx-By\x-y) = ^^(Bx; - By; | x; - yi > > /3 w il Bx * " By £ | 2 = p\\Bx - By\\ 2 , (6.5) 

i=l i=l 

which yields the cocoercivity of B. The other results are clear from the definition, 
(v): Let x G H. We have 

m / m \ m 

OG^AiX+Bx f3(yi)i<i< m e XAiXj = ^ Yi + Bx 

j=l ^ l ~ ^ ' i=l 

3(yi)i<i< m G XAjxJ = J^Wi(-yiM - Bx) 

«4> ^3 ( Yi )i<i< m G X Aixj - (yi/wi, . . . ,y m /u m ) - j( Bx ) G V 1 ' = N v (j{x)) 

& G A(j(x)) + B(j(x)) + AV(j(*)) 

j'(x) G zer(^ + B + N v ), (6.6) 

which yields the result. □ 

The following algorithm solves Problem 6.1 and is a direct consequence of Theorem 4.2. 

Proposition 6.3 Let 7 G ]0, 2/3 [, let a = max{2/3, 27/ (7+2/3)}, let (A n ) ng N a sequence in ]0, l/a[, 
/or every i G {1, . . . , m}, let (a n ) ne pj and (b; !n ) ng N &e sequences in H, and suppose that 

A n (l - aX n ) = +00 and max 7 A n ( |a n | + |bj J J < +00. (6.7) 

neN nGN 

Moreover let (zifi)i<i<m G H m and consider the following routine. 

Em 

For i = 1, . . . , m 

(Vn G N) s i>n = 2x n - z i>n - 7 (Bx n + a„) (6.8) 

^i,n+l — Zj n A n (pj in X n ). 
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Then, the following hold for some solution x to Problem 6.1. 

(i) x n x. 

(ii) Bx„ — > Bx. 

(iii) x n+ i - x„ -> 0. 

Proof Set, for every n G N, x„ = j( x n), a n = j(a n ), & n = (b ii „) 1 < i < m , y n = (yj, n )i<i<m I z n = 
(zi,n)i<i<m, Pn = (pi, n )i<i<m, and q n = (qj, n )i<i<m- It follows from Proposition 6.2(i) and (6.8) that, 
for every n G N, x n = Pyz n . Hence, it follows from (6.3) and Proposition 6.2 that (6.8) can be written 
equivalently as 



(6.9) 





X n — PyZ n 




Vn 


= (x n - Z n )/j 


(Vn G N) 




= x n - ~/P v (Bx n + a n ) + 7y n 




Pn 


— J-yA^n ~(" b n 






+ 1 = Zn + A n (p n - X n ). 


Moreover, it follows from (6.2) and (6.7) that 


K{\\a n \\ + HMD = ^2 M ' a?i l 


+ \ 


^Wj|bj,„| 2 J <^A n (|a n | + 


neN neN V 




i=l / neN V 



< +oo. (6.10) 



i=l 



Altogether, Theorem 4.2 and Proposition 6.2(v) yield the results. □ 
Remark 6.4 

(i) In the particular case when (X n ) n ^ is such that < lim An, < limA n < 1/a and the errors are 
summable, the algorithm (6.8) reduces to the method in [24]. Condition (6.7) allows for a larger 
class of errors and relaxation parameters. 

(ii) Set a n = 0, for every i G {1, . . . , m}, set bj )Tl = 0, let 7 G ]0, 2/3[, and let (\ n )n<=N be a sequence in 
[e, 1] for some e G ]0, 1[. Then it follows from Remark 5.7 that the algorithm in Proposition 6.3 
coincides with the routine: let xq G H, let (yi t o)i<i<m £ H m such that YaLi ^iYifi = 0? an d se t 



(y n g n) 



For i = 1, . . . ,m 



7Bx„ + 7yj ;n 



(6.11) 



Pi,n — J^Ai/uJi^iyn 
_ Yi,n+1 = Yi,n + (An/7)(X^1 w iPi,n ~ Pi,n) 
Xn+1 = Xn + A n (X^i^l w iPi,n ~ X n ) 

which is the method proposed in Corollary 5.5 applied to Problem 6.1. In the particular case 
when B = 0, 7 = 1, and A n = 1, (6.11) reduces to [17, Corollary 2.6]. 

(iii) It follows from (4.8) that, in the case when B = 0, the method proposed in Proposition 6.3 
follows from the iteration 



(Vn G N) z n+ i = z n + A n (T 7 z n + b n - z n ) 



(6.12) 



where A and V are defined in (6.3). This method is very similar to the algorithm proposed in [17, 
Theorem 2.5]. Indeed the only difference is that instead of the operator T 7 = (Id+i? 7 A^Ar y )/2 
used in Proposition 6.3, in [17, Theorem 2.5] is used the operator (Id+i?Ar y i? 7 A)/2. 
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Corollary 6.5 Let 7 E ]0, +00 [, let (\ n )neN be a sequence in ]0,3/2[, for every i E {1, . 
(bi, n )neN sequences in H, and suppose that 

y A n (3 — 2A n ) = +00 and max > A n |bj n | < +00. 



,m}, let 



(6.13) 



nGN 



Moreover, let (zio,Z2o) £ H 2 and consider the following routine. 



(Vn E 



X n = ( z l,n + Z 2 , n )/2 
Pl,n = d2 7 Ai ( z 2,n) + bi )Jt 
P2,n = d2 7 A 2 ( z l,n) + b2,n 
z l,n+l = z l,n + A n (pi jn — X n ) 
z 2,n+l = z 2,n + A n (p2, n — X n ) 



(6.14) 



Then, the following hold for some solution x E zer(Ai + A2). 

(i) x n x. 

(ii) x n+ i - x n -> 0. 

Proof. Is a direct consequence of Proposition 6.3 in the particular case when m = 2, B = 0, a = 2/3, 
and u)\ = 0J2 = 1/2. □ 

Remark 6.6 

(i) The most popular method for finding a zero of the sum of two maximally monotone operators 
is the Douglas-Rachford splitting [32, 45], in which the resolvents of the operators involved are 
computed sequentially. In the case when these resolvents are hard to compute, Corollary 6.5 
provides an alternative method which computes in parallel both resolvents. This method is 
different to the parallel algorithm proposed in [11, Corollary 3.4]. 

(ii) For every i E {1, . . . , to}, set bj jn = and let {\ n )n&i be a sequence in [e, 1} for some e E ]0, 1[. 
Then it follows from Remark 5.7 that the algorithm in Corollary 6.5 coincides with the routine: 
let xo E H, let vo E H, and set 

51, n = X n + 7V n 

52, n = X n - 7V n 
Pl,n = d2 7 AiSl,n 
P2,n = d2 7 A 2 s 2,ra 

Vn+1 = V n + (A n /(27))(p 2j n - Pl,n) 
X n+ i = (1 - A n )Xn + (A n /2)(pi >n + p 2 , n ), 



(Vn E 



(6.15) 



which is the method proposed in (6.11) applied to find a zero of Ai + A2 when oj\ = 0J2 = 1/2 
and y 1)fl = -y 2 ,„ = v„. 

6.2 Variational case 



We apply the results of the previous sections to minimization problems. Let us first recall some 
standard notation and results [7, 50]. We denote by Tq(T-L) be the class of lower semicontinuous 
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convex functions /: % — > ]— oo, +00] such that dom/ = [x £ T~L \ f{x) < +00} 7^ 0. Let / G ro(%). 
The function / + || • — z|| 2 /2 possesses a unique minimizer, which is denoted by proxy z. Alternatively, 

prax / = (Id+a/)- 1 = J 9f , (6.16) 

where df:U^2 H : x ^ {ueH \ (Vy G %) (y — x \ u) + /(x) < /(y)} is the subdifferential of /, 
which is a maximally monotone operator. Finally, let C be a convex subset of 7i. The indicator 
function of C is denoted by lq and its strong relative interior (the set of points in x G C such that 
the cone generated by —x + C is a closed vector subspace of %) by sri C. The following facts will also 
be required. 

Proposition 6.7 Let V be a closed vector subspace ofH, let f G To(^) be such that VRdom/ 7^ 0, 
let g: T~L — > R 6e differentiable and convex. Then the following hold. 

(i) zer(<9/ + Vg + AV) C Argmin(/ + g + i v ). 

(ii) Suppose that one of the following is satisfied. 

(a) Argmin(/ + g + ty) 7^ and G sri(dom f — V). 

(b) Argmin(/ + g + ty) C Argmin / n Argmin(g + ty) 7= 0. 

T/ien zer(d/ + Vg + AV) ^ 0. 

Proof, (i): Since doing = it follows from [7, Corollary 16.38(iii)] that d{f + g) = <9/ + Vg. Hence, it 
follows from VRdom/ 7^ 0, [7, Proposition 16.5(h)], and [7, Theorem 16.2] that zer(df + Vg + AV) = 
zer(9(/ + g) + AV) C zer(<9(/ + g + l v )) = Argmin(/ + g + ty). 

(ii)(a): Since doing = H yields dom(/ + g) = dom/, sri(dom/ — V) = sri(dom(/ + g) — domiy). 
Therefore, it follows from Fermat's rule ([7, Theorem 16.2]) and [7, Theorem 16.37(i)] that, for every 

x en, 

7^ Argmin(/ + g + ty) = zer d(f + g + ty) 

= zer (d(f + g) + N v ) 

= zer (df + Vg + N v ). (6.17) 

(ii)(b): Using [7, Corollary 16.38(iii)] and (i), from standard convex analysis we have 

Argmin / PI Argmin(g + ty) = zer df R zer <9(g + iy) 

= zer df R zer(Vg + AV) 
C zer(a/ + Vg + AV) 

C Argmin(/ + g + ty). (6.18) 
Therefore, the hypothesis yields zev(df + Vg + AV) = Argmin / R Argmin(g + ty) 7^ 0. □ 
The problem under consideration in this section is the following. 

Problem 6.8 Let V be a closed vector subspace of H, let / G T^H), and let g: 7i — > M. be a 
differentiable convex function such that Vg is /3 _1 -Lipschitzian. The problem is to 

minimize f(x)+g(x). (6.19) 
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Problem 6.8 has several applications in partial differential equations [34, Section 3], signal and 
image processing [2, 3, 13, 14, 18, 21, 22, 39, 48], and traffic theory [4, 41] among other fields. 

In the particular case when V = H, Problem 6.8 has been widely studied, the forward-backward 
splitting can solve it (see [4, 16] and the references therein), and several applications to multicomponent 
image processing can be found in [10] and [12]. In the case when g = 0, the partial inverse method 
in [44] solves Problem 6.8 with some applications to convex programming. In the general setting, 
Problem 6.8 can be solved by methods developed in [11, 18, 24] but without exploiting the structure 
of the problem. Indeed, in the algorithms presented in [11, 18] it is necessary to compute prox 9 = 
(Id+Vg) -1 and, hence, they do not exploit the fact that Vc/ is single-valued. In [24] the method 
proposed computes explicitly Vg, however, it generates auxiliary variables for obtaining Py via product 
space techniques, which may be numerically costly in problems with a big number of variables. This is 
because this method does not exploit the vector subspace properties of V . The following result provides 
a method which exploit the whole structure of the problem and it follows from Proposition 5.5 applied 
to optimization problems. 

Proposition 6.9 Let T~L, V , f , and g be as in Problem, 6.8, let 7 G ]0, 2f$\, let a = max{2/3, 27/(7 + 
2/3)}, let (A n ) nS N be a sequence in ]0,l/a[, let (a n ) ne ^ and (6 n )neN be sequences in H, and suppose 
that 

A n (l - a\ n ) = +00 and A n (||a n || + \\b n \\) < +00 



ngN 



nGN 



and that 



Moreover let zq £ % and set 



(Vn € N) 



zer(d/ + Vg + N v ) ^ 0. 



X n — PyZ n 

Vn = (x n ~ Zn)H 

s n = x n - jP v (Vg(x n ) + an) + jy n 

p n = prOX 7/ S n + b n 

— ~\~ A n (p n X n ). 



(6.20) 
(6.21) 



(6.22) 



Then, the sequences (x n )n£N and (y n )neN ar e in V o- n d V^~, respectively, and the following hold for 
some solution x to Problem 6.8 and some y 6 V 1 - n (df{x) + PyVg(x)). 

(i) x n x and y n -± y. 

(ii) x n+ i -x n ^0 and y n +i - y n -> 0. 

(iii) En G N A nll P v(V 5 (x n ) - Vg(x)) || 2 < +00. 

Proof. It follows from Baillon-Haddad theorem [5] (see also [6]) that Vg is /3-cocoercive and, in addi- 
tion, df is maximally monotone. Therefore, the results follow from Theorem 4.2, Proposition 6.7(i), 
and (6.16) by taking A = df and B = Vg. □ 



Remark 6.10 



(i) Conditions for assuring condition (6.21) are provided in Proposition 6.7(h). 
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(ii) Set a n = and b n = 0, let 7 G ]0, 2/3[, and let (\ n )n£N be a sequence in [e, 1] for some e G ]0, 1[. 
Then it follows from Remark 5.7 that the algorithm in Proposition 6.9 coincides with the routine: 
let xq G V, let yo £ U -1 , and set 



(Vn G N) 



Sn = x n - jP v Vg(x n ) + jy n 
p n = prox 7/ s n 

Vn+l =Vn + {K/l){PvPn ~ Pn) 
X n +l = X n + X n (P V p n ~ X n ), 



which is the method proposed in Corollary 5.5 applied to Problem 6.8. 

(hi) Recently in [20] an algorithm is proposed for solving simultaneously 

minimize f(x)+g(x) + h(Lx), (6.24) 
xeH 

and its dual, where Q is a real Hilbert space, h G Tq{Q), and L: is linear and bounded. 

In the particular case when Q = H, h = ly, and L = Id, (6.24) reduces to Problem 6.8. In this 
case, the method is different to (6.22) and, additionally, it needs a more restrictive condition on 
the proximity parameter and the gradient step when the constants involved are equal. 

(iv) Consider the problem involving N convex functions 

N 

minimize > fj(x)+g(x), (6.25) 
xev ^— ' 

i=i 

where H is a real Hilbert space, V is a closed vector subspace of H, (ft)i<i<jv are functions in 
ro(H), and g is convex differentiable with Lipschitz gradient. Under qualification conditions, 
(6.25) can be reduced to Problem 6.1 with m = N + 1, for every i G {1, . . . ,N}, Aj = dfi, 
Aat + i = iVy, and B = Vg. Hence, Proposition 6.3 provides an algorithm that solves (6.25), 
which generalizes the method in [24] in this context by allowing a larger class of relaxation 
parameters and errors. 
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